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Abstract 

We study more general variational problems on time scales. Previous 
results are generalized by proving necessary optimality conditions for (i) 
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order, and (ii) problems of the calculus of variations with delta-differential 
side conditions (Lagrange problem of the calculus of variations on time 
scales) . 
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1 Introduction 

The theory of time scales is a relatively new area, that unify and generalize 
difference and differential equations [5]. It was initiated by Stefan Hilger in the 
nineties of the XX century [71(5], and is now subject of strong current research in 
many different fields in which dynamic processes can be described with discrete 
or continuous models pQ. 

The calculus of variations on time scales was introduced by Bohner [3] and by 
Hilscher and Zeidan [9j , and appears to have many opportunities for application 
in economics [2]. In all those works, necessary optimality conditions are only 
obtained for the basic (simplest) problem of the calculus of variations on time 
scales: in [2j [4] for the basic problem with fixed endpoints, in [9] for the basic 
problem with general (jointly varying) endpoints. Having in mind the classical 
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setting (situation when the time scale T is either E or Z - see e.g. Q3] and 
[T01[Tl], respectively), one suspects that the Euler-Lagrange equations in [21 [HE] 
are easily generalized for problems with higher-order delta derivatives. This is 
not exactly the case, even beginning with the formulation of the problem. 

The basic problem of the calculus of variations on time scales is defined (cf. 
[H [9] , see below for the meaning of the A-derivative and A-integral) as 



C[y(-)]= L(t,y°(t),y A (t))At^ mm, (y(a) = y a ) ,(y(b) = y b ) , (1) 



with L:TxR"xl n -»R, L(t, y, u) a C 2 -function for each t, and where 

we are using parentheses around the endpoint conditions as a notation to mean 
that the conditions may or may not be present: the case with fixed boundary 
conditions y(a) — y a and y(b) — yb is studied in 4J, for admissible functions y(-) 
belonging to C^ d (T;R") (rd-continuously A-differentiable functions); general 
boundary conditions of the type f(y(a), y(b)) = 0, which include the case y(a) or 
y(b) free, and over admissible functions in the wider class C^ rd (T; M. n ) (piecewise 
rd-continuously A-differentiable functions), are considered in [SJ. One question 
immediately comes to mind. Why is the basic problem on time scales defined 
as (p} and not as 



C[y{-)] = / L(t, y(t), y A (t))At — > min, (y(a) = y a ) , (y(b) = y b ) . (2) 



The answer is simple: compared with @, definition |T]) simplifies the Euler- 
Lagrange equation, in the sense that makes it similar to the classical context. 
The reader is invited to compare the Euler-Lagrange condition ^ of problem 
JTJ) and the Euler-Lagrange condition ([T3| of problem ([2]), with the classical 
expression (on the time scale T = K) : 



It turns out that problems ([T]) and ^ are equivalent: as far as we are assuming 
y(-) to be A-differentiable, then y{t) = y a (t) — n(t)y A (t) and (i) any problem 
|T]) can be written in the form {5}, (fi) any problem @ can be written in the 
form {!]). We claim, however, that the formulation ([2]) we are promoting here is 
more natural and convenient. An advantage of our formulation ([2]) with respect 
to ([1]) is that it makes clear how to generalize the basic problem on time scales 
to the case of a Lagrangian L containing delta derivatives of y(-) up to an order 
r, r > 1. The higher-order problem will be naturally defined as 





-L yl {t,y*(t),yi(t)) = L y (t,y*(t),yi(t)), te[a,b]. 




mm, 




(3) 



(y Ar ~ 1 (a) = y l 



a 



), (y^( p r-l {b ))=yl-l), 
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where y A ' (t) G R", i G {0, ...,r}, y A ° = y, and n, r G N (assumptions on 
the data of the problem will be specified later, in Section [3]). One of the new 
results in this paper is a necessary optimality condition in delta integral form 
for problem ([3]) (Theorem 2]). It is obtained using the interplay of problems Jl} 
and @ in order to deal with more general optimal control problems (|16[) . 

The paper is organized as follows. In Section [5] we give a brief introduction 
to time scales and recall the main results of the calculus of variations on this 
general setting. Our contributions are found in Section [3] We start in H3.ll 
by proving the Euler-Lagrange equation and transversality conditions (natural 
boundary conditions - y(a) or/and y(b) free) for the basic problem ^ (The- 
orem [5]). As a corollary, the Euler-Lagrange equation in g] and [9] for |T]) is 
obtained. Regarding the natural boundary conditions, the one which appears 
when y{a) is free turns out to be simpler and more close in aspect to the classical 
condition L y i (a, y*(a), y»(a)) = for problem (fTJ) than to ([2|) — compare condi- 
tion (J9j) for problem ([2|) with the correspondent condition (Tl4|) for problem (TTJ); 
but the inverse situation happens when y(b) is free — compare condition (|15p for 
problem (TT|) with the correspondent condition (fTT)|) for ^ , this last being simpler 
and more close in aspect to the classical expression L y >(b, y*{b), yi{b)) = valid 
on the time scale T = R. In H3.2I we formulate a more general optimal control 
problem p^|) on time scales, proving respective necessary optimality conditions 
in Hamiltonian form (Theorem [3]) . As corollaries, we obtain a Lagrange multi- 
plier rule on time-scales (Corollary [2]), and in H3.3l thc Euler-Lagrange equation 
for the problem of the calculus of variations with higher order delta derivatives 
(Theorem HJ. Finally, as an illustrative example, we consider in §3] a discrete 
time scale and obtain the well-known Euler-Lagrange equation in delta differ- 
entiated form. 

All the results obtained in this paper can be extended: (i) to nabla deriva- 
tives (see [H §8.4]) with the appropriate modifications and as done in [2] for the 
simplest functional; (ii) to more general classes of admissible functions and to 
problems with more general boundary conditions, as done in [S] for the simplest 
functional of the calculus of variations on time scales. 

2 Time scales and previous results 

We begin by recalling the main definitions and properties of time scales (cf. 
[U [2l [8] and references therein) . 

A nonempty closed subset of R is called a Time Scale and is denoted by T. 

The forward jump operator a : T — > T is defined by 

a(t) = inf {s S T : s > t}, for all t G T, 

while the backward jump operator p : T — > T is defined by 

p{t) = sup {s G T : s < t}, for all t G T, 

with inf = supT (i.e., a(M) — M if T has a maximum M) and sup0 = inf T 
(i.e., p{m) = m if T has a minimum m). 
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A point t G T is called right-dense, right- scattered, left-dense and left- 
scattered if a(t) = t, a(t) > t, p(t) = t and p{t) < t, respectively. 

Throughout the text we let T = [a, b] n T with a < b and T a time scale. 

We define T k = T\(p(b),b], T fe2 = (l*)* and more generally T fe " = (l*" -1 ) , 

for n G N. The following standard notation is used for a (and p): <r°(t) = t, 
a n (t) = (a oa n - r )(t), n G N. 

The graininess function p : T — > [0, oo) is defined by 

p(t) = a(t) - t, for all t G T. 

We say that a function / : T — > R is delta differ entiable at i G T fe if there is 
a number f A (t) such that for all e > there exists a neighborhood U of i (i.e., 
[/ = (t — <5, t + <5) n T for some (5 > 0) such that 

\f(a(t)) - f(s) - f A (t)(a(t) - s)\ < e\a(t) - s\, for all s G U. 

We call f A (t) the delta derivative of / at t. 

Now, we define the r th — delta derivative (r G N) of / to be the function 
f Ar : T fer -> R, provided / A ^' is delta differentiable on T fe \ 

For delta differentiable / and g, the next formulas hold: 



r(t) = f(t) + p(t)f A (t) (4) 

{fg) A {t) = f A (t)g°{t) + f(t)g A {t) 
= .f A (t)g(t) + r(t)g A (t), 

where we abbreviate / o <j by f a . 

Next, a function / : T — > M is called rd- continuous if it is continuous at 
right-dense points and if its left-sided limit exists at left-dense points. We 
denote the set of all rd-continuous functions by C rc j or C r( j [T] and the set of all 
delta differentiable functions with rd-continuous derivative by Cj d or Cj d [T] . 

It is known that rd-continuous functions possess an antiderivative, i.e., there 
exists a function F with F A = /, and in this case an integral is defined by 
j h a f(t)At = F(b) - F(a). It satisfies 

J t f(r)Ar = p(t)f(t) . (5) 

We now present some useful properties of the delta integral: 
Lemma 1. If a,b eT and f,g EC r d, then 

1. j b a f{o(t))g A (t)M = \(j9)(t)]t b a - f a f A (t)g(t)At. 
2- & f(t)g A (t)At = [(fg)(t)]\= = b a J b f A (t)g(a(t))At. 
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The main result of the calculus of variations on time scales is given by the 
following necessary optimality condition for problem 

Theorem 1 ([!]). If y* is a weak local minimizer (cf. fJ3|) of the problem 
C[y(-)} = f L(t, y°(t), y A (t))At — min 

J a 

y(-) g cl d [T] 
y(a) = y a , y(b) = w, 

then the Euler- Lagrange equation 

L^(t,yUt),y?(t)) = L y „{t,yZ{t),y${t)), t e T fc2 (6) 

holds. 

Main ingredients to prove Theorem[T]are item 1 of Lemma[T]and the Dubois- 
Reymond lemma: 

Lemma 2 (g]). Let g G C rd , g : [a, b] k -> R™. Then, 




g(t) ■ n A (t)At = for all n G C x ri with r)(a) = n(b) = 



if and only if 

g(t) = c on [a,b] k for some c G R™. 



3 Main results 

Assume that the Lagrangian L(t,uo(t),ui(t), . . . ,u r (t)) (r > 1) is a C +1 func- 
tion of (ito(£),ui(£), ■ • ■ ,u r (t)) for each tel. Let y G C£ d [T], where 

Cvd[ T ] = {?/ : Tfe ' K " : is rd-continuous on T fer | . 

We want to minimize the functional C of problem ([3]). For this, we say that 
y* G C^pT] is a weafc ZocaZ minimizer for the variational problem ([3]) provided 
there exists S > such that £[y*] < £[y] for all y G C£ d [T] satisfying the 
constraints in ([3J and \\y — y*||r,oo < S, where 

r 

\\y\\r,oo ■= V \\y A ' 

* — ' II oo 

with y A " = y and HyHoo := sup t6Tfc . \y(t)\. 
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3.1 The basic problem on time scales 

We start by proving the necessary optimality condition for the simplest varia- 
tional problem (r = 1): 

,6 

C[y(-)] = / L(t,y(t),y A (t))At ^ min 



(7) 

(y(a) = Va) , (y(b) = yb) ■ 

Remark 1. We are assuming in problem |7]) that the time scale T has at least 
3 points. Indeed, for the delta-integral to be defined we need at least 2 points. 
Assume that the time scale has only two points: T = {a, &}, with b = a(a). 
Then, f° {a) L(t,y{t),y A (t))At = p(a)L(a,y(a),y A (a)). In the case both y{a) 
and y(a(a)) are fixed, since y A (a) = v ^ a ^ a J^ v ^ , then £[?/(•)] would be a con- 
stant for every admissible function y(-) (there would be nothing to minimize 
and problem (JT]) would be trivial). Similarly, for we assume the time scale 
to have at least 2r + 1 points (see Remark [T5j) . 



Theorem 2. If y* is a weak local minimizer of ([7]) (problem (J3]) with r = 1), 
then the Euler- Lagrange equation in A-integral form 

L y ±(t,y*(t),y A (t)) = f ' L^,y*(0,y* A (e))A£ + C (8) 

J a 

holds Vi S T k and some c G W 1 . Moreover, if the initial condition y(a) = y a is 
not present (y{a) is free), then the supplementary condition 

L y ±(a,y*(a),y A (a)) ~ p(a)L y (a,y*{a),y A {a)) = (9) 

holds; if y(b) = y^ is not present (y(b) is free), then 

L y ±(p(b),y4p(b)),y A (p(b))) = 0. (10) 



Remark 2. For the time scale T = R equalities (J9J) and (|10|) give, respec- 
tively, the well-known natural boundary conditions L y > (a, y*(a), y*(a)) = and 
L v ,(b,y*Q>),y:(b))=0. 

Proof. Suppose that £/*(•) is a weak local minimizer of £[•]. Let rj(-) SCj d and 
define $ : K -> E by 

*(£)=/%,(.)+«?(•)]. 

This function has a minimum at e = 0, so we must have $'(0) = 0. Applying 
the delta-integral properties and the integration by parts formula 2 (second item 
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in Lemma [I}, we have 
= $'(0) 



a(t) 



Ly{Z, y.(0, v?(t))M ■ v A (t) - V(*. f*(*)> ' ^ A (*) 



At. 



(11) 

Let us limit the set of all delta-differentiable functions r/(-) with rd-continuous 
derivatives to those which satisfy the condition 77(a) = rj(b) — (this condition 
is satisfied by all the admissible variations rj(-) in the case both y(a) = y a and 
y{b) — yi, are hxed). For these functions we have 



<x(t) 



L v A(t,y4t),y?(t)) - I L y (Z,y*(0,y*(0)^ 



v A (t)At = 0. 



Therefore, by the lemma of Dubois-Reymond (LemmadJ), there exists a constant 
ceM" such that © holds: 



L y A(t,y*(t),y?(t)) 



*(t) 



L y (t;,y*(0,y?(0)^ = c 



(12) 



for all t ET k . Because of (|12l) . condition (jTTJ) simplifies to 



L y {t,y*{t),y?{t)At-r)(t) 



t=b 



+ c-v(t)\lZ b a = 0, 



for any admissible rj(-). If y(a) = y a is not present in problem ([7]) (so that rj{a) 
need not to be zero), taking r}(t) = t — b we find that c = 0; if y(b) = yt, is not 
present, taking rj(t) = t — a we find that L y (t,y*{t),y^{t) — 0. Applying 
these two conditions to (|12p and having in mind formula ([5]) , we may state that 



Ly* (a,j/*(a),yf (a)) 



J a 

<=> L y A(a,y*(a),y A (a)) - n(a)L y (a,y*(a),y A (a)) = 0, 
and (note that <j(p(b)) = b) 

V(p(6), y*(p(b)),y?(p(b))) - f L y (t y*(0,V*(0)^ = 

J a 

V(p(6),y,(p(6)),^ A (p(6)))=0. 



□ 
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Remark 3. Since o~(t) >t, Vt G T, we must have 



v (t, y *(t), y A (t)) - mWM*, »•(*). !/*(*)) 



t 

A / 



L y (t;,y*(0,y?(0)^ + c, 

by formula (J3J). Delta differentiating both sides, we obtain 

(V (t, y, (t) , (<)) - ^(t)L„ (t, y* (t), y A (*))) A 

= L v (t,y.{t),y?(t)), teY k \ (13) 

Note that we can't expand the left hand side of this last equation, because we 
are not assuming that fi(t) is delta differentiable. In fact, generally fi(t) is not 
delta differentiable (see example 1.55, page 21 of [S]). We say that fT3"|) is the 
Euler-Lagrange equation for problem (J7|) in the delta differentiated form. 

As mentioned in the introduction, the formulations of the problems of the cal- 
culus of variations on time scales with "(t, y a (t) , y A (t))" and with "(i, y(t), y A (t))" 
are equivalent. It is trivial to derive previous Euler-Lagrange equation ((6|) from 
our equation (|13p and the other way around (one can derive (|13[) directly from 

©)• 

Corollary 1. //y* G CrdPH * s a ^eo^ foca/ minimizer of 

£[</(•)]= [ L(t,y°(t),y A (t))At, (y{a) = y a ), (y(b) = y b ), 

J a 

then the Euler-Lagrange equation ^ holds. If y(a) is free, then the extra 
transversality condition (natural boundary condition) 

L y A(a,y°{a),y A (a))=0 (14) 

holds; if y(b) is free, then 

L y «(p(b),y°(p(b)),y A (p(b)))p(p(b)) + L y ,(p(b),y:(p(b)),y A (p(b))) = . (15) 
Proof. Since y(t) is delta differentiable, then (j4|) holds. This permits us to write 

L(t, if(t), y A (t)) = L(t, y(t) + ^(t)y A (t) , y A (<)) = F(t, y(t),y A (t)). 
Applying equation (|13|1 to the functional F we obtain 

( V (t, tf(t), y A (t)) - /*(t)F„(t, y(t), y A (i))) A = F„(t, y(t), y A (i)). 

But 



(t, y(f), y A (t)) = V (*> (*)> V A (*)) ■ 



.A/ 



F„ A (t, j,(t), = V (*, y a {t),y A {t))ii{t) + LyA (t, y°(t),y A (t)) , 

and the result follows. □ 
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3.2 The Lagrange problem on time scales 



Now we consider a more general variational problem with delta-differential side 
conditions: 



where y{-) € C} d [T], u(-) G C rd [T], y(t) G E n and u(t) G K m for all t G T, 
and m < n. We assume L : T x 1" x K m -> R and </j : T x K" x W n -> R n 
to be C 1 -functions of y and w, for each t; and that for each control function 
tt(-) G C rd [T;]R m ] there exists a correspondent y(-) G C^[T;R n ] solution of 
the A-differential equation y A (i) = <p(t,y(t),u(t)). We remark that conditions 
for existence or uniqueness are available for OAE's from the very beginning 
of the theory of time scales (see [H Theorem 8]). Roughly speaking, forward 
solutions exist, while existence of backward solutions needs extra assumptions 
(e.g. regressivity) . In control theory, however, one usually needs only forward 
solutions, so we do not need to impose such extra assumptions [3]. 

We are interested to find necessary conditions for a pair to be a weak 

local minimizer of J. 

Definition 1. Take an admissible pair (y*,u*). We say that (y*,«*) is a weak 
local minimizer for (|16|) if there exist 5 > such that J\y*,u*\ < J[y,u] for all 
admissible pairs {y,u) satisfying \\y — y*||i,oo + \\u — u*||oo < 5. 

Remark 4. Problem (I16p is very general and includes: (i) problem ((7|) (this 
is the particular case where m = n and ip(t,y,u) = u), (ii) the problem of 
the calculus of variations with higher-order delta derivatives (]3]) (such problem 
receive special attention in Section [3731 below), (hi) isoperimetric problems on 
time scales. Suppose that the isoperimetric condition 



j3 a given constant, is prescribed. We can introduce a new state variable y n +i 
defined by 



and we can always recast an isoperimetric problem as a Lagrange problem (|16|) . 

To establish necessary optimality conditions for (fH)]) is more complicated 
than for the basic problem of the calculus of variations on time scales (fT]) or ([2]), 
owing to the possibility of existence of abnormal extremals (Definition [2]). The 
abnormal case never occurs for the basic problem (Proposition [5]) . 




mm , 



(16) 



y A (t) =<p(t,y(t),u(t)), 
(y(a) = y a ) , [y(b) = y b ) 
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Theorem 3 (The weak maximum principle on time scales). If (?/*(•), it*(-)) is 
a weak local minimizer of problem (|16[) . then there exists a set of multipliers 
(V>o, j "0*(')) 7^ 0; where "00, a nonnegative constant and ip*(') '■ T ~ * R™ is a 
delta differentiable function on T , such that (y*(-), u* (■), ipo, ? "0*(')) satisfy 

yf{t) = H4,*(t,y*(t),u*(t),ipo t ,ipZ (t)) , (A-dynamic equation for y) (17) 
ipt'it) = — H y (t, y*(t), u*(t), ipo t , '0* (i)) i (A-dynamic equation for ip ) (18) 
H u (t,y*{t),u^(t),'il)Q t , ipl (t)) — , (A- stationary condition) (19) 

/or a/Z i S T fc ; where the Hamiltonian function H is defined by 

H(t, y, u, V> , V) = ^oi(t, V, u) + ^ ' ¥>(*> V, «) ■ (20) 



^*(a) = 0; (21) 



If y(a) is free in (|16[) . i/iera 
if yip) is free in $TE\i . then 

M">)=0. (22) 

Remark 5. From the definition (|2"0|) of 7?, it follows immediately that (p~7|) holds 
true for any admissible pair (y(-), ■«(•)) of problem (fTI)]) . Indeed, condition Q17p 
is nothing more than the control system y£(t) = (f(t, y*(t), u*(t)). 
Remark 6. For the time scale T = Z, (JTTJ) - (|T5J) reduce to well-known conditions 
in discrete time (see e.g. [13l Ch. 8]): the A-dynamic equation for y takes the 
form y{k + 1) — y(k) = [k, y(k), u(k), ipo, ip(k + 1)); the A-dynamic equa- 
tion for ip gives ip(k + 1) — ip(k) = — H y (k, y(k), u(k), tpo, ip(k + 1)); and the 
A-stationary condition reads as H u (k, y(k), u(k), i/)q, %l>{k + 1)) = 0; with the 
Hamiltonian H = ip L(k, y{k),u(k)) + ip(k + 1) • tp(k, y(k), u(k)). For T = R, 
Theorem [3] is known in the literature as Hestenes necessary condition, which is 
a particular case of the Pontryagin Maximum Principle [12] . 

Corollary 2 (Lagrange multiplier rule on time scales). If (y*(-), «*(•)) * s a 
weak local minimizer of problem (|16[) . </ien i/iere exists a collection of multipli- 
ers (V'o»>V'*("))> V'o, a nonnegative constant and tp*{-) : T — > R n a cieZia di/- 
ferentiable function on T k , not all vanishing, such that (?/*(•)> u *('), V'o, ; 
satisfy the Euler- Lagrange equation of the augmented functional J* : 
,6 

/*!»(•),«(•). W]= / i*(t,y(t),tt(t),^W,y A W)At 



[^£(t, *(*)>«(*)) + ^(*) • «(*)) - y A (*))] At (23) 

[H{t, y(t), u(t),il> , ~ r{t) • y A (t)]At . 

Proof. The Euler-Lagrange equations (fT3|) and ([6]) applied to (|23|) give 



(- A1 (t)i;) A = l; , l;„ = o, 
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that is, 

(r(t)+rtt)-H y f = -H y , (24) 

(-fi(t)H u ) A = H u , (25) 
y A (t) = , 

where the partial derivatives of H are evaluated at (t, y(t), u(t), ipo, ip a (t)). Obvi- 
ously, from (TT9")) we obtain ([23]) . It remains to prove that (fT3)) implies along 
(y»(-), m»(-), -0o» , Indeed, from (fig)) we can write [i(t)ip A (t) = —fi(t)H y , 
which is equivalent to ^(t) = ip"{t) + fi(t)H y . □ 

Remark 7. Condition (I18| or (|24p imply that along the minimizer 

r(t) = - r ' 1/(0, «(0> Vto, lT (0)A£ - c (26) 

./ a 

for some c G M n . 

Remark 8. The assertion in Theorem [3] that the multipliers cannot be all zero is 
crucial. Indeed, without this requirement, for any admissible pair (y(-),u(-)) of 
p^) there would always exist a set of multipliers satisfying (pTH|) - (pTU|) (namely, 
4> = and ip(t) = 0). 

Remark 9. Along all the work we consider tp as a row-vector. 

Remark 10. If the multipliers (ipo,i[>(-)) satisfy the conditions of Theorem [31 
then ('yipo, r yip{-)) also do, for any 7 > 0. This simple observation allow us to 
conclude that it is enough to consider two cases: ipo = or tpo = 1. 

Definition 2. An admissible quadruple (y(-), u(-), ipo, ip(-)) satisfying condi- 
tions (fT7| - (fT9)) (also (|2l|) or ([22]) if y(a) or y(b) are, respectively, free) is called 
an extremal for problem (|16[) . An extremal is said to be normal if ipo = 1 and 
abnormal if = 0. 

So, Theorem [3J asserts that every minimizer is an extremal. 

Proposition 1. The Lagrange problem on time scales (|16l) has no abnormal 
extremals (in particular, all the minimizers are normal) when at least one of the 
boundary conditions y(a) or y(b) is absent (when y(a) or y(b) is free). 

Proof. Without loss of generality, let us consider y(b) free. We want to prove 
that the nonnegative constant ipo is nonzero. The fact that ipo 7^ follows from 
Theorem [3J Indeed, the multipliers ipo and ip(t) cannot vanish simultaneously 
at any point of t G T. As far as y(b) is free, the solution to the problem must 
satisfy the condition ip(b) = 0. The condition ip(b) — requires a nonzero value 
for ipo at t = b. But since ipo is a nonnegative constant, we conclude that ipo is 
positive, and we can normalize it f Remark 1 10p to unity. □ 

Remark 11. In the general situation abnormal extremals may occur. More 
precisely (see proof of Theorem [3j, abnormality is characterized by the existence 
of a nontrivial solution ip(t) for the system ip A (t) + ip a {t) ■ (p y = 0. 
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Proposition 2. There are no abnormal extremals for problem ([7]), even in the 
case y{a) and y(b) are both fixed (y(a) = y a , y(b) = yt). 

Proof. Problem ([7]) is the particular case of (HHJ) with y A (t) = u(t). If ijjQ = 0, 
then the Hamiltonian (|20[) takes the form H = ip a ■ u. From Theorem[3J ip A = 
and tp" = 0, for all t £ T k . Since ^p a — ip + /i(t)ip A , this means that tpo and ip 
would be both zero, which is not a possibility. □ 

Corollary 3. For problem ([7j, Theorem^ gives Theorem^ 

Proof. For problem (J7J we have ip(t,y,u) = u. From Proposition [21 the Hamil- 
tonian becomes H(t,y,u,ipo,?p c ') = L{t,y,u) + ip a ■ u. By the A-stationary 
condition (fl9)) we may write L u (t,y,u) + i) a — 0. Now apply (|26[) and the 
result follows. □ 

To prove Theorem [3] we need the following result: 

Lemma 3 (Fundamental lemma of the calculus of variations on time scales) . 
Let g g C rd , g : T k -> R n . Then, 



{ g(t) ■ rj(t)At = for all rj £ C rd 

J a 



if and only if 



g(t) = on T k , 



Proof. If g{t) = on T fc , then obviously f a g(t) ■ rj(t)At = 0, for all r] 6 C rd . 

Now, suppose (without loss of generality) that g{to) > for some to £ T fc . 
We will divide the proof in two steps: 

Step 1: Assume that to is right scattered. Define in T fe 



ri(t) 



1 if t = t ; 

if t ^ to- 



Then rj is rd-continuous and 



g(t) v (t)At = f ( Q) g(t) v (t)At = (i(t )g(t ) > 0, 

Jt 

which is a contradiction. 

Step 2: Suppose that to is right dense. Since g is rd-continuous, then it is 
continuous at to. So there exist 5 > such that for all £ £ (to — <5, to + S) D T k 
we have <?(t) > 0. 

If t is left-dense, define in T fe 



v(t) 



(t-to + S) 2 (t-t Q -S) 2 if t £ (t -5, t + ^); 
otherwise. 



It follows that rj is rd-continuous and 

pb pto—6 rto+S pb 

g{t) V (t)At= g(t) V (t)At+ g(t)r)(t)At+ g(t) V (t)At > 0, 

J a J a J to — 5 J tQ-\-S 
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which is a contradiction. 

If to is left-scattered, define in T k 



(t~t -5) 2 if iG [to, to + 5); 
otherwise, 



where < S < min{/x(p(to), £)}• We have: 77 is rd-continuous and 

6 /-to+<5 

g{t)r){t)At= / g(t) V (t)At>0, 
J t a 

that again leads us to a contradiction. □ 

Proof, (of Theorem |3|) We begin by noting that u(t) = (ui(t), . . . , u m (t)) in 
problem (fT6|) . t G T fe , are arbitrarily specified functions (controls). Once fixed 
u(-) G C rd [T;R TO ], then y(f) = (yi(t), . . . , y n (t)), t G T fe , is determined from 
the system of delta-differential equations y A (t) = <p(t, y(t), u(t)) (and boundary 
conditions, if present). As far as u(-) is an arbitrary function, variations lu(-) G 
C r d[T;IR m ] for u(-) can also be considered arbitrary. This is not true, however, 
for the variations ??(•) GCj d [T;R n ] of y(-). Suppose that (y*(-), u*(0) i s a weak 
local minimizer of J[-, •]. Let e G (—5, S) be a small real parameter and y e (t) = 
j/*(t)+£7j(t) (with 77(a) = if y(a) — y a is given; 77(6) = if y(b) = yb is given) be 
the trajectory generated by the control u e (t) — u*(t) +eu)(t), ui(-) G C r d[T; R m ]: 

y*(t) = ip(t,y £ (t),u £ (t)), (27) 

t G T fe , (y £ (a) — y a ), {ys(b) = yb)- We define the following function: 

*(e) = J [&(•),«*(•)] = J MO + «?(•).«*(') + MO] 
eft 

L(t,y*{t) +er)(t),u*{t) + su{t)) At. 



It follows that $ : (—8,6) — » R has a minimum for £ = 0, so we must have 
$'(0) = 0. From this condition we can write that 

b 

ty L y {t,y4t),u*{t))-r)(t)+i;oLu{t,y*(t),u*{t))-u}(t)]At = (28) 



for any real constant ipQ. Differentiating (|27|) with respect to e, we get 

77 A (t) = Vv (t, y e (t), u e (t)) ■ rj{t) + p u (i, y e (t), u e (t)) • w(t) . 
In particular, with s = 0, 

?7 A (t) = <p y (*, y* (*) , (*)) • »7(*) + (*, y* (*) , «. (*)) • w(t) ■ (29) 

Let VO) eCj d pT;R n ] be (yet) an unspecified function. Multiplying (3SJ) by 
= [^1 (*)>••• jV'nC*)]) anc ^ delta-integrating the result with respect to f 
from a to 6, we get that 

rb rb 

/ ip°(t)-rt A {t)At= [ijj' 7 {t)-vyr 1 {t)+^{t)- Vu -uu{t)]At (30) 
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for any ip(-) e Cj d [T;M™]. Integrating by parts (see Lemma[TJ formula 1), 

" r(t) ■ v A (t)At = m ■ r,(t)\ h a - f 4, A {t) ■ v (t)At , (31) 

J a 

and we can write from (|28p. and (J^H) that 

(^ A (t) + ^j, + ^ CT (t) • • v(t) 

+ {^ L U + ^(t) ■ Vu ) • w(t)] At - ^>(t) • r?(*)l« - (32) 
hold for any ip(t). Using the definition ([20)) of H, we can rewrite (|32|) as 

[(^ A (t) + ff^) • V (t) + H u ■ w (t)] At - </>(*) • »7C*)I* - ■ (33) 



It is, however, not possible to employ (yet) Lemma OH due to the fact that 
the variations rj(t) are not arbitrary. Now choose ip(t) = tp*(t) so that the 
coefficient of rj(t) in (j3"3"| vanishes: if} A (t) = —H y (and 7/>*(a) = if y(a) is 
free, i.e. 77(a) ^ 0; -0* (6) = if y(b) is free, i.e. 77(b) 0). In the normal case 
ip*(t) is determined by (?/*(•), u*(-)), and we choose ipo, — 1< The abnormal case 
is characterized by the existence of a non-trivial solution ip*(t) for the system 
"0 A (*) + ' = 0: in that case we choose ipo t = in order to the first 

coefficient of r](t) in (f3"2")) or (f3"3"|) to vanish. Given this choice of the multipliers, 
the necessary optimality condition (|33p takes the form 



/ H u ■ uj(t)At = . 

J a 



Since ui(t) can be arbitrarily assigned for all t 6 T , it follows from Lemma [3] 
that H u = 0. □ 

3.3 The higher-order problem on time scales 

As a corollary of Theorem[3]we obtain the Euler-Lagrange equation for problem 
(02). We first introduce some notation: 

y°(t) = y(t), 



y r -\t) = y* (t), 



II 



(t) = 2/ A (t) 
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Theorem 4. If y* G Cy^T] is a weak local minimizer for the higher-order 
problem ([3]), then 

V*- 1 {v(t))=-L u (t,x4t),u*(t)) (34) 

holds for all feT r , where x*{t) = (y*(t), yf(f), • • • and VJ^VW) 

is defined recursively by 

1>°Wt))=- ['* L y o(Z, x* (0,«*(0) + co, (35) 

^k*)) - - r ' [m& + ^rV(O)] a? + ci, i = i, . . . , r - 1 , 

J a 

(36) 

wzift Cj, j — 0, ... ,r — 1, constants. If y A (a) is free in ([3]) for some i € 
{0, ...,r — 1}, a G {a,/9 r (&)}, f/ien ifte correspondent condition ipl(a) = 
holds. 

Remark 12. From ([34]), ([35]) and (36|) it follows that 

i« + ^(~1) M / ■ • • / L V i + [ci] r _<_ x = 0, (37) 
»=o ^ a ^ a 

where [cj] r _j_i means that the constant is free from the composition of the r — i 
integrals when i — r — 1 (for simplicity, we have omitted the arguments in L u 
and L y i ) . 

Remark 13. If we delta differentiate (|3~T|) r times, we obtain the delta differen- 
tiated equation for the problem of the calculus of variations with higher order 
delta derivatives. However, as observed in Remark [3l one can only expand 
formula (|37[) under suitable conditions of delta differentiability of fi(t). 

Remark 14. For the particular case with <p(t, y, u) — u, equation ([5]) is (|37p with 
r = 1. 

Proposition 3. The higher- order problem on time scales (J3]) does not admit ab- 
normal extremals, even when the boundary conditions y A (a) and y A (p r ~ 1 {b)) ; 
i = 0, . . . , r — 1, are all fixed. 

Remark 15. We require the time scale T to have at least 2r + 1 points. Let 
us consider problem ([3]) with all the boundary conditions fixed. Due to the 
fact that we have r delta derivatives, the boundary conditions y A (a) — y l a and 
y A (p r ~ 1 (b)) = y\ for all i G {0, . . . , r — 1}, imply that we must have at least 2r 
points in order to have the problem well defined. If we had only this number of 
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points, then the time scale could be written as T = {a, o~(a), . . . , a 2r (a)} and 

/ L(t,y(t),v A (t),---,y A (*))A* 

= (n) i(t,yW,y A (t),...,y Ar (t))Af (38 ) 

i=0 Jcr '(a) 

= ]T L(a\a),y(a\a)), y A (a\a)), . . . , 

where we have used the fact that p r ~ 1 (a 2r ~ 1 (a)) = a r {a). Now, having in mind 
the boundary conditions and the formula 

f A M _ /(*(*)) ~ /(*) 

we can conclude that the sum in (|38|) would be constant for every admissible 
function y(-) and we wouldn't have nothing to minimize. 

The following technical result is used in the proof of Proposition [3] 

Lemma 4. Suppose that a function f : T — > R is such that f a (t) — for all 
t E T k . Then, f(t) = for all t £ T\{a} if a is right-scattered. 

Proof. First note that, since f a (t) = 0, then f a {t) is delta differentiable, hence 
continuous for all feT*. Now, if t is right-dense, the result is obvious. Suppose 
that t is right-scattered. We will analyze two cases: (i) if t is left-scattered, 
then t ^ a and by hypothesis = f a (p(t)) = f(t)\ (ii) if t is left-dense, then 
f(t) = lim^j- / CT (s) = / CT (i), by the continuity of f a . The proof is done. □ 

Proof, (of Proposition [3]) Suppose that tpo — 0. With the notation (|40[) intro- 
duced below, the higher order problem ([3]) would have the abnormal Hamilto- 
nian given by 

r-2 

H(t, y °,..., y r -\ u,i>°, . . . , r- 1 ) = E ^ w*)) • y l+1 (*) + ^ r_1 (^(*)) • «(*) 

t=0 

(compare with the normal Hamiltonian (|4ip). From Theorem [31 we can write 
the system of equations: 

' $°(t) =0 
ft® = -^(a(t)) 

: (39) 

$ r_1 (*) = -^ r - 2 (^(t)) 

I ^ r - 1 (^(*)) -o, 

for all t 6 T k , where we are using the notation ft(t) = ip tA (t), i = 0, . . . ,r — 1. 
From the last equation, and in view of Lemma [H we have ip(t) — 0, Vi S 
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T fer+1 \{a} if a is right-scattered. This implies that V> r_1 (t) = 0, Vi G T fer \{a} 
and consequently i/^VM) = 0, Vi G T fcr \{a}. Like we did before, i> r ~ 2 {t) = 
0, Vi G T fe \{a,er(a)} if a (a) is right-scattered. Repeating this procedure, we 
will finally have ^(i) = 0, Vi G T fer \{a, . . . , cr r - 2 (a)} if cr l (a) is right-scattered 
for all i G {0, ... , r — 2}. Now, the first and second equations in the system (|39[) 



imply that Vi G A = T fe ''\{a, . . . , <r r ~ 2 {a)} 

- ^(i) - -VVW) = ^°(*) + A*(t)^ A (*) = ■ 

We pick again the first equation to point out that ip°(t) — c, Vi G T fc ' +1 and 
some constant c. Since the time scale has at least 2r + 1 points (Remark [T5|) , 
the set ^4 is nonempty and therefore - 0°(i) = 0, Vi G T fc . Substituting this 
in the second equation, we get V' 1 (i) =0, Vi G T k . As before, it follows that 
^/> 1 (i) = d, Vi G T fe and some constant d. But we have seen that there exists 
some to such that V' 1 (io) = 0, hence xjj x {t) = 0, Vi G T fc . Repeating this 
procedure, we conclude that for all i G {0, . . . , r — 1}, ij) % (t) — at i G T k . This 
is in contradiction with Theorem [3] and we conclude that ipo ^ 0. □ 

Proof, (of Theorem SJ Denoting y(t) = y A (t), then problem |3j) takes the fol- 
lowing form: 

/•P r_1 («0 

C[y(-)} = / L(t, y°(t),y\t), . . . , ^(i), U (i))Ai — > min, 

J a 



y = y 
y 1 = y 1 



(40) 



V 
u 



(»*(«) 



t/&J 



o,. 



1, and y£ G 



System (|40p can be written in the form y A = Ay + Bu, where 

y=(y ,y\..., y ^) = ( y 1 ,..., y ° n ,yl 
and the matrices A (nr by nr) and B (nr by n) are 



Vn- 1 ) 



( I 
0/ 





V o o o 



o \ 




7 
o / 



B = coZ{0,...,0,7} 



in which I denotes the n by n identity matrix, and the n by n zero matrix. 
From Proposition [3] we can fix tp — 1 ; problem (|40|) is a particular case of (Ti"6]) 
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with the Hamiltonian given by 



r-2 



L(t, y ,..., y r -\u) + J2 ■ V l+1 + ^ VO) ' «• (41) 



i=() 



From (gni) and (H]), we obtain 

r(a(t)) = - H y ,^,x(0,u(0,r(0)^ + <k, ie{0,...,r-l} (42) 



= H u (t,x(t),u(t),i> a (t)), 



(43) 



respectively. Equation (j4"3"|) is equivalent to (|34[> . and from (|4"2")l we get ([33]) - 



4 An example 

We end with an application of our higher-order Euler-Lagrange equation (|37| 
to the time scale T = [a, b] fl Z, that leads us to the usual and well-known 
discrete-time Euler-Lagrange equation (in delta differentiated form) - see e.g. 
[TT] . Note that W 6 T we have a(t) = t + 1 and fj,(t) = a(t) - t = 1. In 
particular, we conclude immediately that fj,(t) is r times delta diffcrcntiable. 
Also for any function <?, g A exists Mt 6 T fe (see Theorem 1.16 (ii) of [5]) and 
g A (t) = g(t + 1) — g(£) = Ag is the usual forward difference operator (obviously 
g A exists Vi S T' and more generally g A ' exists \/t S T fc , r € N) . 
Now, for any function / : T — > R and for any j 6 N we have 



-i A 3 



a J a 



/ At 



/ ActJ , iG{0,...,i-l}, (44) 



j—i integrals 



where / AVJ stands for / A V i_< (*))- To see this we proceed by induction. 
For j = 1 

/ /(£)A£ = / /(£)A£ = / /(OA^ + / /(OAC 



= / /(0A£ + /(*), 



and then 



/ o °" (t) /(£)A£ = /(t) + f A {t) = f a . Assuming that (H} is true for 
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all j = 1, . . . , k, then 

r a(t) 



a J a 



/ At 



k-\-X—i integrals 



A k+i 



/At 



/At 



CT (t) 



/ A CT " + ( / 



A 



/At 



CT (t) 



/At 



AV 



= / 

Delta differentiating r times both sides of equation ([37| and in view of (|44|) . 
we obtain the Euler-Lagrange equation in delta differentiated form (remember 
that y° = y, . . ., y r ~ x = y Ar \ y A ' = u): 



L y&r (t,y,y 



^(-ly-^y-* (t, y ,2/ A , . . . , y Ar ) = 0. 



5 Conclusion 

We introduce a new perspective to the calculus of variations on time scales. In all 
the previous works [HIU[H] on ^ e subject, it is not mentioned the motivation for 
having y a (or y p ) in the formulation of problem (JTJ) . We claim the formulation 
^ without a (or p) to be more natural and convenient. One advantage of 
the approach we are promoting is that it becomes clear how to generalize the 
simplest functional of the calculus of variations on time scales to problems with 
higher-order delta derivatives. We also note that the Euler-Lagrange equation 
in A-integral form ([5]), for a Lagrangian L with y instead of y a , follows close 
the classical condition. Main results of the paper include: necessary optimality 
conditions for the Lagrange problem of the calculus of variations on time scales, 
covering both normal and abnormal minimizers; necessary optimality conditions 
for problems with higher-order delta derivatives. Much remains to be done in 
the calculus of variations and optimal control on time scales. We trust that our 
perspective provides interesting insights and opens new possibilities for further 
investigations. 
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